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Abstract 

In this manuscript, we investigate optimal control problems which 
arise in connection with manipulation of dissipative quantum dynam- 
ics. These problems motivate the study of a class of dissipative bilinear 
control systems. For these systems it is shown that the optimal so- 
lution and the reachable set can be found by solving a semidefinite 
program. In practice, solutions to these problems generate optimal 
methods for control of quantum mechanical phenomena in presence 
of dissipation. In the area of coherent spectroscopy, this translates 
into the maximum signal to noise ratio that can be obtained in a 
spectroscopy experiment. 



1 Introduction-Statement of the Problem 

Consider the following optimal control problem. Given the dynamical system 
below 
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and starting from the initial state e\ = (1, 0, 0, 0) T , what is the maximum 
achievable value of x 2 and what are the optimal controls vi(t) G K and 
v 2 (t) G 3? that achieve this value? Problems like this are associated with 
optimal manipulation of quantum mechanical phenomena under dissipation. 
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ences, Harvard University, Cambridge, MA 02138 USA (e-mail: stefanat@fas.harvard.edu; 
navin@eecs.harvard.edu) . 
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Specifically, the optimization problem stated above comes from Nuclear Mag- 
netic Resonance (NMR) spectroscopy and is related to optimal control of 
two coupled spins in presence of transverse relaxation £Q. The state vari- 
ables Xi, yi represent averages of various quantum mechanical spin operators. 
The available controls v\(t) and i> 2 (t) correspond to the components of the 
magnetic field in the NMR experimental setup. Parameter k > expresses 
the transverse relaxation rate while J is the coupling constant between the 
spins. 

Observe that if V\ and i> 2 are set to then the initial state e\ doesn't 
evolve at all and there is no build up of x%- However, by turning on v±, it 
is possible to rotate X\ to yi, see Fig. [T] This evolves to y 2 under the skew 
symmetric matrix 

" -J 
J J ' 

while both y\ and ?/ 2 dissipate under the term 

—k 
—k ' 

The state y 2 can then be rotated to xi by switching on the control i> 2 . We 
want to find the optimal v\ and v<i that maximize the value of x 2 - It is 
intuitively clear that no matter how large we make ■ui(t), t> 2 (t), the transfer 
xi — > X2 cannot be done without any loss, since the intermediate transfer 
Hi ~> IJ2 is entirely due to internal dynamics over which there is no control, 
thus there is an unavoidable dissipation because of k > 0. 
Define 

n = \jx* + yf . (2) 
Using (0), evolution equations for ri,r 2 can be found. We get the system 
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where cos0i = yi/Yi, cos 02 = 2/2/^2, see Fig. [T] Using the control v\ which 
rotates x\ to y%, we can control the angle X . Analogously, using t> 2 which 
rotates y 2 to x 2 , we can control the angle 2 . Denoting u\ = cos0i, u 2 = 
cos 2 and dilating time by a factor of J, the above system can be rewritten 

as 

h 

Here u\ and m 2 are control parameters which take their values in the interval 
[— 1, 1] and £ — k/ J. The initial problem of maximum transfer from x\ to x 2 
has been transformed to the following equivalent question: 
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Figure 1: Schematic representation of the evolution of system Control v\ 
rotates x\ to y\. Under the J coupling y\ evolves to y2, while both dissipate 
because of the relaxation term k. Control t> 2 rotates y 2 to x 2 . The new 
state variables ri,r 2 , defined by (J2J), are also shown. The corresponding new 
control parameters are u\ = cos0i,w 2 = cos0 2 . 

Given the dynamical system (J3J) and the initial state (ri(0), r 2 (0)) = 
(1,0), find the optimal control (u\(t), u 2 (t)), l^i], |u 2 | < 1, such that r 2 is 
maximized. 

Note that once r 2 is maximized, the control t> 2 can be used to transfer it 
to x 2 with no loss, so the above question is indeed equivalent to the original 
problem. 

Motivated by this example, which originates from a real physical system, 
let us consider the following n-dimensional generalization of system 
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where x = (x 1} x 2 , . . . , x n ) T , y = (y u y 2 , . . . , y„) T , V = diag(ui, v 2 , . . . , v n ) 
and A = {a^} is such that its symmetric part A + A T is negative definite. 
This condition insures that the norm of the vector (x, y) can only decrease. 
This models the physics in open quantum systems, where dissipation can only 
reduce coherence in the system dynamics. Furthermore, A is such that any 
two states yi and yj are coupled by its off-diagonal elements, not necessarily 
directly (we say A is irreducible) . 

Problem 1 Given the dynamical system and the starting state (x(0), 2/(0)), 
find the optimal control (vi(t), f 2 (t), . . . ,v n (t)) which maximizes x n . 

It is shown in the following section that the negative definiteness condition 
on A is a sufficient condition for the existence of an optimal solution. 



3 



If we define r , = J x 2 + y 2 and work as in the 2-dimensional case, we find 
that Ti satisfies the equation 

dri n 

~1T = Y1 "■ J ">> , J r J > ( 5 ) 

where Ui = yijri. Problem ^ has been transformed to the following. 

Problem 2 Given the dynamical system defined by for i = 1,2, ... ,n, 
with A = {a, L j} irreducible and such that A + A T negative definite, and the 
starting state (ri(0), ^(0), . . . , r n (0)), with rj(0) > 0, find the optimal con- 
trol (ui(t),U2{t), . . . ,u n (t)), \ui\ < 1, which maximizes r n , while it preserves 

n(t) > o. 

Observe that if T\ < T 2 , then the maximum achievable value in time T\ 
cannot exceed the corresponding value in time T 2 , since by putting Ui = 
the evolution in the interval (Ti,T 2 ] can be stopped. Therefore, Problem El 
is considered as an infinite horizon problem. 

Multiplying the i th equation of system (jHJ) with 2r i; we get 



d n 

( r i) = ZaijUiUjnrj (6) 
i=i 



dt 



and from this 



where 



By setting 



— ( r 2 ) = U 2 V2a - — ^ (7) 



U 



\ i=l 



'UjJT^ , . 

p i = r i , mi = — , (9) 
and rescaling time according to dt' = U 2 dt, equation ((Zj) becomes 

^7 = it Zaijmmj ■ (10) 

The initial optimal control problem has been transformed to the following 
one. 
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Problem 3 Given the dynamical system defined by il(J\) for i = 1,2, ... ,n 
and the starting point p(0) = (pi(0),p 2 (0), . . . ,p n (0)) T , Pi(0) >0, find the 
unit vector m{t') = (mx(t'), m2(t f ), . . . ,m n (t')) T that maximizes p n , while it 
preserves Pi(f) > 0. Matrix A = {a^} is irreducible and such that A + A T 
is negative definite. 

Note that, although Problem El is an infinite horizon problem, Problem El 
defined above may achieve its maximum for a finite final time Tf. There is no 
inconsistency here, since the times for the two systems are related through 



dt' = U 2 dt, so T f = Jp dt' = / °° U 2 dt. If U{t) -> sufficiently fast as 



t — > oo, then Tf is finite. As we will see, this is indeed the case. 

In the following, we study problems El and 01 in detail. Having found an 
optimal solution for the latter, we can easily find a corresponding optimal 
control law for the former. The structure of the paper is as follows. In section 
El it is shown that the solution of Problem El can be reduced to the solution of 
a semidefinite program and that the negative definiteness of the symmetric 
part of A is a sufficient condition for the existence of an optimal solution. It 
is also shown how the semidefinite programming formalism can be used for 
calculating reachable sets. In section El some useful existent results regarding 
the rank of matrices that solve our semidefinite program are presented. These 
results are used in section^ where some specific examples are examined. The 
examples include system Q and another system which again arises from an 
optimal control problem of spin dynamics in NMR spectroscopy. 

2 Reduction to a Semidefinite Program 

In the following, the inner product (• , •) in the space of symmetric n x n 
matrices Sym n is defined in the usual way as the trace of the matrix product, 
i.e. (A, B) = tr(AB) for A,B e Sym n . Note also that A y denotes that 
matrix A G Sym n is positive semidefinite, A -< that is negative definite etc. 

Theorem 1 Let us define matrices A^ G Sym n ,i = 1,2, ... ,n, by the rela- 
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where are the elements of matrix A given in Problem^ and On, I = 
1,2,3,4, are zero matrices with appropriate sizes. The solution of Problem^ 
can be reduced to the solution of the following semidefinite program: 

Find £ = ma.x(A n , M) 

subject to (Ai, M) = —pi(0) , i — 1, 2, . . . , n — 1 
and M y . 
The maximum achievable value of p n is p n (0) + £ . 

Proof: Let Tf be the time when p n achieves its maximum, i.e. the final 
time. From equation (fTUj) it is 

Pi (T f ) = Pi (0) + J2 2a n r m(t')m 3 (t')dt' . (11) 
j= i J o 

Observe that if we define the positive semidefinite matrix M through the 
relation 

M = [ Tf m(t')m T (t')dt' , (12) 



o 

then (|TT|) becomes 

p i (T f )= Pi (0) + (A i ,M) . (13) 

One other important observation is that the end point of the optimal 
trajectory should lie on the line (0, 0, ... , 0,p n ) in p-space. Suppose that the 
end point has a component pk > for some k ^ n. If pk is directly coupled 
to p n then choose m = (0, 0, . . . , 0, m k , 0, . . . , 0, m n ) T such that m n (a n / c m fc + 
0'nn m n) > and evolve the system until p k = 0. Thereby we get a greater 
value of p n . If pk is not directly coupled to p n , we can still transfer from pk to 
p n using intermediate states (because matrix A is irreducible). We conclude 
that at the final time Tf the end point of the optimal trajectory should lie on 
the line (0, 0, ... , 0,p n ). Thus, we have to maximize p n (Tf) = p n (0) + (A n , M) 
under the conditions Pi(Tf) = Pi(0) + (Ai,M) = 0, i = 1, 2, . . . , n — 1. 
Equivalently, we have to solve the following semidefinite program: Find £ = 
max M (A n ,M) subject to (A h M) = -pi(0) for i = 1,2, . . .,n-l and M y 0. 

Having found an optimal M, we can always find an appropriate unit 
vector m(f) such that M = fp m(t')m T (t')dt' and piit') > 0. Since M y 0, 
it can always be decomposed in the form 

r 

k=i 
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where X k are the positive eigenvalues of M, m k are the corresponding (real) 
normalized eigenvectors and r is the rank of M. Now let N be a positive 
integer. Rewrite the above relation in the form 



r 



k=l 



where A\ k = X k /N, and define the times t' k through 



k 



t' = 0, 4 = ^AA ; for fc=l,2, ...,r. 



1=1 



Let us forget for a moment the restrictions Pi(t') > 0. If we apply the control 



is satisfied and on the other hand the trajectory in p-space approximates 
the line joining the initial point 7(pi(0),p2(0), . . . , p n (0)) to the final point 
F(0,0, . . . ,p n (Tf)), see Fig|2fa). If N is large enough then the trajectory 
actually follows this line, see Fig. |2fb), thus the restrictions Pi(t') > are 
satisfied. Note that T f = ££ =1 A fc = tr(M) is finite, if tr(M) < +oo. In 
the special case where r = 1, it is M — Amm T and thus m(t') = m for 



The conclusion is that we just need to solve the semidefinite program 
defined above. The maximum achievable value of p n is p n (Tf) = p n (0) + £. 

m 

We show next how this control law can be applied to system (JHJ) in Prob- 
lem El For < t' < ti, m(t') = mi = constant. Since, additionally, mi is a 
unit vector, we can assume without loss of generality that its first component 
nil 7^ 0. Consider the ratios 



m(t') = m fc for t' h _ x <t' <t' k , k = 1, 2, . . . 



r 



and repeat for times, then on the one hand the requirement 
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Figure 2: (a) Trajectory in p-space following the control law presented in the 
text, for r = 2 and N = 4. It approximates the straight line from the initial 
point / to the final point F. Note that the restrictions Pi(t') > may not be 
satisfied when N is small (b) For large N the trajectory coincides with the 
line IF, so the restrictions Pi(t') > are satisfied. 



The optimal policy can be realized as 

1 



Sin 

Ui = Ui , 

Ti 

where i — 2, 3, . . . , n. With the above choice we insure that \m\ < 1. Using 
this feedback law we can evolve system (jSJ in time t and calculate the function 

U{t) = Er=i(^ r *) 2 - Tnen > we can find t' = So U 2dt - when t' = t[, we switch 
to m(t') = m 2 and repeat the above procedure. If the rank of M is r = 1 
then the ratios keep the same value for all times. Note that the maximum 
achievable value of r n is 

r„(oo) = sJv~jTi) = vfto) + S = ^(0) + £ . (14) 

In the above discussion we implicitly assumed that an optimal solution 
exists, and we used for S the characterization "maximum" instead of the 
more formal "supremum" . We show below that the negative definiteness of 
A + A T is a sufficient condition for the existence of an optimal solution. The 
following lemma is used. 

Lemma 1 // B y and M >z 0, B, M e Sym n , then (B, M) > 0. 
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Proof: Since B G Sym n it can be diagonalized by an orthogonal ma- 
trix O, B — OAO T , where A = diag(Ai, A 2 , . . . , X n ) and Aj > are the 
eigenvalues of the positive definite matrix B. It is 



(B, M) = tr(BM) = tr{OAO T M) = tr{AO T MO) = tr(AM) = ^ \ 



rrii 



8=1 



where M = T MO and its diagonal elements. But M T = M and 

x T Mx = (Ox) T MOx > for every x G 9?™, since M y 0. So, it is also 
M >z and thus fhu > 0. Since, additionally, A« > 0, we conclude that 
(B, M) = £?=i Aim« > 0. ■ 

Theorem 2 // A+A T -< then the semidefinite program defined in Theorem 
has an optimal solution. 

Proof: First we show that the set S of all matrices M >z satisfying 
the equality constraints (A4, M) = — Pi(0), % = 1, 2, . . . , n — 1, is non-empty. 
Indeed, the matrix 

M = diag(-p 1 (0)/2o 11 , -p 2 (0)/2a 22 , . . . , -p n (0)/2a nn ) 

satisfies these conditions and, additionally, it is M ^ 0, since Pi(0) > and 
an < (A + A T -< 0). Note that S is closed and convex. Now consider 
the function / : S — > 3? defined by f(M) = (A n , M) and the matrix B = 
- E"=i A = ~{A + A T ) y 0. From Lemma □ and for M e S, we have 



n-l 



n— 1 



(5, M) > (A n , M)<-J2 ( A h M) = J2 Pi(0) < +00 /(M) < +00 



»=i 



»=i 



Thus sup Me5 /(M) < +00 and since 5 is closed the supremum is achieved 
for a M G 5, so it is actually a maximum. The existence of an optimal 
solution is established. ■ 




Figure 3: Construction of the reachable set of point I. 
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We finally show how the semidefinite programming formalism can be used 
for calculating the reachable set of point 7(pi(0),p 2 (0), . . . ,p n (0)). Consider 
the line e parallel to p n -axis, with pi = constant > 0, % = 1, 2, . . . , n — 1. 
The maximum achievable value of p n on e, starting from /, can be found by 
solving the following semidefinite program: Find maxM{A n , M) subject to 
(Ai, M) = Pi — Pi{0) for i = 1, 2, . . . , n — 1 and M >z 0. If this program has 
a solution M such that p n = p n (0) + (A n , M ) > 0, then let P be the point 
(pi,P2, ■ ■ ■ ,Pn) of e, see Fig. El This point belongs to the reachable set of 
/. Additionally, every point N(p\,p 2 , . . . ,p n -i,p' n ) of e with < p' n < p n , 
see Fig. El belongs also to the reachable set (first arrive at P and then 
use m = (0, 0, ... , 1) T to go down, since (fTUj) gives p n = a nn < 0, p\ = 
for i 7^ n). Thus, the segment PQ, where Q(pi,P2, ■ ■ ■ ,Pn-i, 0), is in the 
reachable set. By repeating the above procedure for all the allowed e \\ p n , 
the reachable set of / can be constructed. 

3 Remarks on the Rank of the Semidefinite 
Program Solutions 

In the preceding section we saw that the bigger the rank of the optimal M for 
the semidefinite program, the more complicated is the optimal control law. 
Thus, it would be useful to know if there exist low rank optimal solutions 
and, additionally, rank upper bounds for them. Even more, we would like 
to know for what matrices A the corresponding semidefinite program has 
solutions of the lowest possible rank r = 1. In this section we present a series 
of results in these directions. 

Lemma 2 Let us fix A%, A 2 , A k 6 Sym n and aii, a 2 , . 6 SR. // there 

is a matrix M >- such that 



(A, M)= ai , i 



1,2,. 



then there is a matrix Mq >z such that 



(Ai, M ) = ^, i 



1,2,... 



k 




Proof: See chapter II, proposition 13.1. 
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Proposition 1 If A + A T -< then there is an optimal solution M to the 
semidefinite program defined in Theorem^ with 



rankM < 



VSn + 1 - 1 



Proof: From TheoremElwe have that, since A+A T -< 0, the semidefinite 
program has an optimal solution M y 0, which satisfies 

(A, M) = -pi{0) , z = l,2,...,n-l, (A n ,M)=£. 

According to Lemma El there exists a Mq y such that 



(Ai, M ) = -pi(0) , i 



1,2, 



, n — 1 



(An, M ) = £ 



and 



rankM < 



VSn + 1 - 1 



Obviously Mo is also an optimal solution. ■ 

Corollary 1 If A + A T -< and i is 2 x 2, t/ien t/ie semidefinite program 
has an optimal solution of rank r < 1 . 

Proof: Apply Proposition Q for n = 2. ■ 
In general, the bound imposed by Lemma El is the best possible. However, 
there is one special case where it can be sharpened. 

Lemma 3 For some positive integer r, let us fix k = (r + 2)(r + l)/2 matrices 
Ai, A 2 , A k e Sym n , where n > r + 2, and k numbers ai, a 2 , . . . , a fc G 
// there is a matrix M y such that 

(A i ,M)=a i , i = l,2,...,k 

and the set of all such matrices is bounded, then there is a matrix M y 
such that 

k 



{A h M Q ) = a u z = l,2, 



and, additionally, 



rankM < r . 

Proof: See chapter II, proposition 13.4. ■ 

Proposition 2 If A + A T -< and A is 3x3, then the semidefinite program 
has an optimal solution of rank r < 1 . 
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Proof: Since A + A -< 0, the semidefinite program has an optimal 
solution M >z 0, which satisfies 

(A h M) = - Pi (0), 2 = 1,2, (A n ,M) = £. 

From Lemma El we see that the choice r = 1 gives k = 3 = n, since n = 3 
according to the hypothesis of the proposition. In order to apply Lemma El 
we just need to show that the set of optimal matrices, i.e. all the matrices 
M y satisfying the above relations, is bounded. Consider the matrix 
B = - Ei=i Ai = -(A + A T ) y 0. For a matrix M y in the set of optimal 
solutions, we have 

(B, M) = Pl (0) + p 2 (0) - 8 < +oo . 

But from Lemma we have also (B,M) = Y^=i where A, are the 

eigenvalues of B and fhu the diagonal elements of the matrix M = T MO, 
O the orthogonal matrix diagonalizing B. Combining these we find that 

3 

i=i 

Since Aj > and fhu > 0, the above relation implies that 

fhu < +oo , 

thus 

tr(M) = tr(M) < +oo . 

But 

(M, M) = tr(M 2 ) < (tr(M)) 2 < +oo , 

since M y 0. So indeed the set of optimal M is bounded and we can apply 
Lemma El with r = 1. This means that there is an optimal M y with 
rankM < 1. Note that the bound that Proposition ^ gives in this case is 
only [(V8 -3 + 1 - 1)/2J =2. ■ 

Lemma 4 Let us call an nxn matrix A = {a^} r -diagonal if = unless 
\i — j\ < r. Suppose that the matrices Ai, A 2 , A^ e Sym n are r-diagonal 
and there exists a matrix M y such that 

(A*, M) = en e & , i = l,2,...,k. 

Then there exists a matrix Mq y such that 

(A,M ) = a t , i = 1,2,..., A; 

and, additionally, 

rankM < r . 
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Proof: See |2J, chapter IV, corollary 10.3, problem 3. 



Proposition 3 If A + A T -< and A is r-diagonal, then the semidefinite 
program has an optimal solution of rank < r. 

Proof: Since A + A T -< 0, there exists an optimal solution of the 
semidefinite program. Since A is r-diagonal, the corresponding A{ are also 
r-diagonal. Thus, we can apply Lemma HJ which assures the existence of an 
optimal solution of rank <r. ■ 
We conclude this section by noting that there is strong numerical evidence 
that the following conjecture is true. 

Conjecture 1 If A + A T -< then the semidefinite program has an optimal 
solution of rank r = 1 . 

4 Examples 

In this section we solve problems 121 and El for some specific systems. We start 
from the system with 



which corresponds to system (jSJ) appeared in the introduction. It is not neces- 
sary to solve numerically the corresponding semidefinite program, because we 
can attack this particular case analytically. Since A+A T = diag(— 2£, — 2£) -< 
and A is 2 x 2, from Corollary ^ we have that there is an optimal solution 
to the semidefinite program with rank r < 1. Thus, there is an optimal 
constant vector m = (m 1 ,m 2 ) T , solution to ProblemEl The system equation 
(jlOj) with A given above and m constant gives 



Pi(T f ) =pi(0) -(£m? +mim 2 )T f , p 2 {T } ) = p 2 (0) + (m 2 m 1 -£ml)T f . (15) 



.4 



£>o, 



Optimality requires 



Pl (T f ) = 0^T f 



Pi(0) 



(16) 



£mf + m,\m 2 ' 



so 



p 2 (7» = p 2 (0) + 



m 2 m,\ — ^,m\ 



Pi(0) ■ 



(17) 
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In order to maximize p 2 (Tf), we just need to maximize the coefficient of 
Pi(0). If we set m 2 /mi = x, then this coefficient takes the form 

/<*> - ^ ■ (is) 

Before maximizing /, we find the allowed values of variable x. It should be 
p 2 (7» > p 2 (0) =>• x - £a; 2 > and pi(7» < pi(0) =>• a: + £ > 0. These 
are both satisfied when a; G [0, l/£]. We calculate the maximum of / in this 
interval. It is not difficult to verify that 

/'(*) = -^ffi (-) 

becomes zero at the point 



x = ^l + e-Z (20) 

of the interval [0, l/£]. Also verify that f'(x) > for a; G [0, a; ) and /'(x) < 
for a; G (a; , l/£]- So /(x ) is a maximum in the interval [0, l/£]. After some 
manipulation we find that 

f(x )=x 2 . (21) 
The maximum achievable value of p 2 is 

P2 (T f ) = p 2 (0) + x 2 oPl (0) (22) 

and the optimal unit vector is 

™ = ("H^f > -r=?) ■ ( 23 ) 



The optimal trajectory in p-space is a straight line joining the points (pi(0), p 2 (0)) 
and (0,^(7))). 

The maximum achievable value of r 2 is 



r 2 (oo) = V / ^(0)+xgr 1 2 (0) . (24) 

If the starting state is the point (ri(0), r 2 (0)) = (1, 0), the maximum transfer 
efficiency takes the value 



r 2 (w)=x = Jl + e-Z- (25) 
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For £ = 1 this efficiency is \[2 — 1. The optimal controls Ui,u 2 for system 
©, can be found by using the method described in section |21 If we define 



M. = max ( 1 



r 2 J 



the optimal policy can be realized as 



M r 2 

Observe that the initial point (1, 0) is a stationary point of the optimal control 
policy [/^(O) = =>■ M. — oo =>- u\ — =>- u 2 — 0]. This optimal policy in 
the infinite horizon case should then be interpreted as the limit of optimal 
control policy for the corresponding finite time problem [Finite time for the r» 
system, don't confuse it with the finite time problem for pi which corresponds 
to the infinite horizon problem for rj. It is the special case k\ = k 2 = of 
the finite time problem solved in the preceding chapter. The solution for this 
particular case can be found in jT]]. In practice, we give a small but finite 
value in r 2 (0) (an initial 'kick' from zero) which makes the optimal control law 
applicable. In Fig. Ufa) we plot the optimal controls U\ and u 2 . In Fig. @Jb) 
we depict ri(t),r 2 (t) and in Fig. Efc) the corresponding optimal trajectory 
in r-space. For all these figures it is £ = 1 and (ri(0), r 2 (0)) = (1,0). 

Remark 1 The closure of the reachable set of point (1,0) is 



R((l, 0)) = {n, r 2 > | yVl + x\r\ < x } , 

where x$ = y/1 + £ 2 — £. This set is depicted in Fig. ^fc) for £ = 1. 
The closure of the reachable set JZ((1, 0, 0, 0)) for the corresponding bilinear 
system J7J) is 



{{xi,x 2 , 2/2 ) e | vSi+^i) + ^o(^i + < ^o} 
The next case that we examine is the system with 



A 



-£ -1 
1 -£ -1 
1 -f 



, £>0 



Since A + A T = diag(— 2£, — 2£, — 2£) -< and A is 3 x 3, from Proposition 
121 we have that the semi definite program has a solution of rank r < 1. Now 
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Figure 4: (a) Optimal controls Ui(t) and «2(£) for system (JHJ) when £ = 1 and 
(ri(0), r 2 (0)) = (1,0) (b) The corresponding state variables r x (t) and r 2 (t) 
(c) The optimal trajectory in r-space. 
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let us become more specific, so set £ = 1 and consider the starting point 
(pi(0),p 2 (0),p 3 (0)) = (1, 1,0). The corresponding matrices A+ are 





' -2 


-1 


" 




' 1 







" 










-1 








, A 2 = 


1 -2 


-1 










1 















-1 










1 


-2 



If we solve numerically the corresponding semidefinite program using some 
appropriate software package, for example SDPT3 [3 , we find that the opti- 
mal matrix M >- is 



M 



0.1775 0.3225 0.1304 
0.3225 0.5856 0.2368 
0.1304 0.2368 0.0958 



and the maximum achievable value of p 3 is 

p 3 (7» = p 3 (0) + (A 3 , M) = (A 3 , M) = 0.2821 . 

It is easy to verify that this matrix has two zero eigenvalues and one nonzero, 
so its rank is indeed r = 1. It can be written in the form M = \mm T , where 
A = 0.8589 (= Tf) is the nonzero eigenvalue and 

m = (mi,m 2 ,m 3 ) T = (0.4546, 0.8257, 0.3339) T 

the corresponding eigenvector. This unit vector is the optimal solution for 
Problem El 

The maximum achievable value of r 3 is r 3 (oo) = ^JpsiTf) = 0.5311. We 
find the optimal u\, u 2 , u 3 . Let us set 



If we define 



fflo 

x = — = 1.8163. 

mi 



Ai = rnaxfl 



^ = 0.7345 . 



mi 
x n y r 1 . 



r 2 

then the optimal policy can be realized as 

1 XqTi 



r 3 



Ml 



M' 



U-2 



r 2 



-Mi, u 3 



r 3 



-Ml . 



Observe that the initial point (1, 1,0) is a stationary point of the optimal 
control policy [r 3 (0) = => M. = oo ^> u\ — =^ u 2 = u 3 = 0]. The 
situation is similar with that in the previous example. Again, the optimal 
policy in the infinite horizon case should be interpreted as the limit of the 
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Figure 5: (a) Optimal controls Ui(t),u 2 (t) and u 3 (t) for system (jSJ), with A 
the 3x3 matrix given in the text, when £ = 1 and (ri(0), ^(O), ?"3(0)) = 
(1, 1,0) (b) The corresponding state variables ri(t),r 2 (t) and r 3 (t). Observe 
that r2(t)/ri(t) = 1 throughout. Remember that the optimal trajectory in 
p-space is a straight line ending at the point (0, 0,p 3 (Ty)), so P2(t)/Pi(t) = 
p 2 (0)/pi(0) = 1 for the starting point (1, 1,0) (c) The optimal trajectory in 
r-space. 
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optimal policy for the corresponding finite time problem. In practice, a small 
but finite value is given to r 3 (0). In Fig. 0a) we plot the optimal controls 
Ui,U2 and w 3 . In Fig. Efb) we depict ri(t), r 2 (/f:), r 3 (t) and in Fig. EJ^c) the 
corresponding optimal trajectory in r-space. 

Another interesting case to examine is the same system with £ > un- 
specified and starting point (pi(0), 0,p 3 (0)). This problem can be solved an- 
alytically and has the practical application that it gives an upper bound for 
our ability to coherently control a specific dissipative quantum system |3j . As 
before, we know that there is an optimal constant vector m = (1711,1712, m 3 ) T '. 
From equations (fTO]) we find 

Pi{T f ) = px(0) - (im\ + m 1 m 2 )Tf , 

ViiTf) = p 2 (0) + (m 2 mi - ^mj - m 2 m 3 )T / , (26) 
p 3 (T f ) = p 3 (0) + (m 3 m 2 - £m 3 )T/ . 



Optimality requires 



Pl (T,) = => T f = - 2 Pl(0) (27) 

£mf + miiri2 



and 

P2(Tf) = =>- 17121711 — — morris = . (28) 
So, we have to maximize 

P3(r /)= P3(o) + ^r^V (o) (29) 

£mf + 171x1712 



subject to the constraint (|28|) . We just need to maximize the coefficient of 
pi(0) under the same condition. If we set 



m 2 m 3 

— = x, — = y , 

mi mi 

then this coefficient takes the form 

9(x,y)= x + ^ , (30) 

while the condition becomes 

x{l-tx-y) = 0=>y = l-Sx. (31) 

Note that x=0 gives g < so it is rejected. Using (pTTj). g becomes a function 
of x only 

/ x = g{x,y(x)) = — . 32 

x + 4 
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We find the allowed values of x. A natural requirement is p 3 {Tf) > p 3 (0) =>■ 
y(x — £y) > =>■ (y > and x — ^y > 0) or (y < and x — < 0). 
Using (|31jl we find that the first option implies x\ < x < X2 and the second 
X2 < x < xx, where x\ = 6/(1 + £ 2 ),x 2 = l/£. Since x\ < X2, only the 
first option is acceptable, so it must be x G [xi,x 2 ]. For such x, the similar 
requirement Px(Tf) < Pi(0) =>• x + £ > is satisfied. So we maximize / in 
the interval [xi,x 2 ] = [6/(1 + £ 2 ), l/£]- Solving the equation f'(x ) = 0, we 
find 



x = sje + 2 - e (33) 
Indeed, Xq G [xi,^]- The corresponding maximum value of / is 

fmax ~~T ■ (34) 

The maximum achievable value of p 3 is 

p 3 {T f ) = p 3 {0) + f maxPl {0) . (35) 



Condition (|28|) implies that in the optimal case it is p 2 = 0, so it is also 
7*2 = 0. If r 2 (0) = then r 2 (t) = and, as we can see from there is no 
transfer from ri to r3. What we actually examine here is the limiting case 
r 2 (0) = e — ► + , where e is an arbitrarily small positive number. We can still 
use condition (|28|) . i.e. f 2 = 0. The transfer n — * r3 takes place through r 2 
which is held to the small constant value r 2 = e. The maximum achievable 
value of r 3 , which corresponds to the limit e — > + , is 



r 3 (ooJ 



\fr 2 3 (0) + f max r 2 (0). (36) 



If the starting state is the point (l,e,0), where e — > + , the maximum effi- 
ciency is 



r 3 (oo) = yjf max = — = . (37) 

For ^ = 1 we find that this efficiency is 2 — \f?>. In Fig. |B] we plot the 
optimal controls u\(t), w 2 (t), w 3 (t), the state variables rx(t), r 2 (t), r 3 (t) and 
the optimal trajectory in r-space. Observe that the starting point is actually 
(l,e, e). It is necessary to give a small positive initial value to r 3 , since the 
point (l,e, 0) is still a stationary point of the optimal policy. If the starting 
point is (l,e, e), then by solving the corresponding semidefinite program we 
find numerically the same efficiency as in (|3*?j) . in the limit e — > + . 
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Figure 6: (a) Optimal controls U\{t),ui{t) and u^{t) for system (jHJ), with A 
the 3x3 matrix given in the text, when £ = 1 and (Vi(0), r 2 (0), r 3 (0)) = 
(l,e, e), < e < 1. Here we take e = 0.01 for convenience (b) The cor- 
responding state variables ^(t), r 2 (t) and r 3 (t). Note that transfer r\ — > r 3 
takes place through r 2 which is held to the small constant value r 2 = e. Thus, 
this transfer requires more time compared to the preceding examples (c) The 
optimal trajectory in r-space. 
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5 Conclusion 



In this paper we studied a class of bilinear control systems, motivated by 
optimal control problems arising in the context of dissipative quantum dy- 
namics. It was shown that the optimal solution and the reachable set of 
these systems can be found by solving a semidefmite program. As a practi- 
cal result, solutions to these problems give upper bounds for the ability to 
coherently control quantum mechanical phenomena in presence of dissipa- 
tion. In the area of coherent spectroscopy, these results translate into the 
maximum signal that can be obtained in an experiment. The paper also mo- 
tivates the use of semidefmite programming to study reachable sets of more 
general bilinear control systems. 
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